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Abstract 



This study compares 50 ESL compositions written 1n class to 50 ESL. 
compositions written at borne. It further compares accuracy on the syntactic 
level and lluencVon the. discourse or rhetorical level for the class and 



home conditions. 



To evaluate a data base of 100 essays, measures were developed to assess 
syntactic 7 and discourse properties separately. Syntactic accuracy was mea- 
sured using a ratio of words per error. The*measure used to evaluate dis- 

course fluency was a holistic score designed to measure adherence -to or'ganl- 

# • * * 

zatlon and coherence only. m 

While T-tests showe.d that there was no statistical significance to the 
differences 1n class and home performance, many of the subjects -did show 1m- 
proved performance at. home on an individual basis.' Furthermore, the compari- 
son between the scores achieved for 'syntactic* accuracy and discourse fluency 

■ 

shows no relationship between the two scores on- Individual compositions". 

We can conclude/ that time does not buy very rrtuch for students in tlie* 
improvement of either their syntax or their organization, apd that ^vel of 
performance in these two areas 1s not Interdependent. 
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Writing 1s freb>ently 'the most difficult skill <*rea 'for an*, language 
user, which 1s to say that writing 1s a challenging task 1tt one's own lan- 
guage as well as 1n a second language. This difficulty does not exempt 
foreign students at American universities from ha' ing to write papers as part . 
of their student careers re'gardjess of their major subjects at school. How-. 
ever, 4 1t seems fair to say that this is a particularly difficult task for 
them. English as a second language (ESL) students must, learn to create 
written products wMch illustrate mastery'not only in, all of the areas re- 
leted to the rhetorical presentation of ideas, but also in the area of syntax', 
a Herculean task given the possibilities for error. For teachers to structure . 
courses that will help foster progress 1n their ESL students, % I believe that 
more researches needed on what the writing of non-native speakers actuary, 
looks like so that real 1st tc goals' can be establish- ,We' need to know what 
students do do in order to know what we can ask them to do. / . • : " 

One* of the difficulties 'in establishing clear goals is the fact that the 
question' of nativt-speaker proficiency is hardly a. simple issue. There is 
just no written standard that can be said to represent the "ideal" written 
product in English. Therefore, we can't easily establish procedures for 
evaluating ESL writing in terms of adherence to some model of native-speaker 

t 

writing. Furthermore, there is much documentation of the output of a type of 
non-successful native speaker often referred to as a "basic writer." .In a • 
now classic major study of a population of basic .writers, Shaughnessy (1977) 
has jmdi cated that mistakes learners make are often neither attempts to de- 
liberately sabotage language in reckless disregard of its rules nor necessar- 
ily careless inattention to details. Rather, as her study shows, the mistakes 
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' df learners are often the result of Internally consistent and carefully 
. worked out. but misguided Interpretations of language. Many errors on the 
^>art of ESL students stem from similar sources, and these errors often 

* 

seriously interfere with' the communicative efficacy of a piece of prose. 

In this study, I would like to examine both the occurrence of error and 
to assess whe.ther or not there 1s a connection between the level of ^yn tact 1c 
accuracy and the overall organizational success of a student essay!' Essen- 
tially what we are looking at 1s the question of whether It Is ppssible to 
write a good essay 1n bad English or a bad essay 1n good English. 

These 1ssues<w1ll be addressed 1n terms of a research focus that has not 
received much attention previously, namely the .Issue ^f 'time. Does time buy 
a reduction of error and jit Improvement"!' n manner of presentation? The major 
research focus of this study will thus be on how the factor of the time 
allowed for the preparation of an essay affects its success both on the syn- r 

* 

tactic and the discourse level. 

% 

♦ 

Methodology 

# » 

In this report, I will present a descriptive analysis of 100 .essays 
written by 25 advanced ESL students. Much previous research on writing has 
analyzed compositions which were produced under strictly controlled con- * 

4 

ditions, with specified time limitations. In addition to analyzing compo- 
sitions collected in the usual test/pressure situational will also be analy- 
zing essays produced at a more leisurely pace, with more opportunity for t^ 
writer to think over the subject matter, check on grammatical principles, re- 
vise passages, and engage 1n whatever other behaviors can accompany the • 
writing process over time that tend to disappear with a restriqted time' frame. 
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The compositions to be analyzed here are divided Into two major groups:, 
those produced 1n class and under pressure of time and those produced at home 
. w-pfh 10-14 days preparation time. In the analysis of the essays, I will con- 

i- 

ft* 

stantly be comparing the. class essays to the home essays because we would 

• •'•'»' 

like to know whether the removal of the time pressure has any effect on the 
actual products~of the writing process. -The description of the essays will 

* • ■ . » . 

first Identify what it 1s that students produce and then what 1t.1s that time 
buys for them. 

What I will show is that while the .time allowed for the preparation of 
an essay often contributes to Improvement for a writer both on the lyntactid 
level and the rhetorical level, it does not necessarily create a sufficiently 
better" essay £o approach statistical significance. In my analysis, I will 
also discuss the relationship between grammatical accuracy and organlza- 
Jipnal success to show that the two occur Independently of each other. • 
Hypotheses • 

s 

Behind the close analysis of these 100 papers are the following three 

3 

hypotheses: > 

(1) Writing produced in class under pressure of time will exhibit less 
control over syntax than writing produced outside of class (at home). 

(2) Writing produced in class under pressure of time, will*' exhibit a 
lower level of organizatl onalf skill than: writing produced outside 
of class (at home). 

(3) There is no necessary relationship between syntactic accuracy* and 
discourse fluency. 

The first hypothesis stems from Krashen's monitor model j(Krashen, 1977; 
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1981), which predicts that given certain conditions, the learner can apply 
consciously learned grammar rules to alter and Improve their written or 
spoken utterances. Briefly, monitor theory begins with the tenet that. Ian- 
guage 1s rule-governed behavior, but there are two w?ys 1n which this be- 
havior 'becomes part of any one Individual's performance. The first way 1s . 
through acquisition, which Krashen (1977) defines as the Internalization of 
linguistic abilities without conscious focusing on*Hngu1st1c forms ; The* 

• . ■ . 

second path to attaining a linguistic skill Is, 1n. contrast to acquisition, 

* • n « 

a .conscious process which Krashen. (J 977) calls learning. Krashen claims that 

i 

conscious learning 1s available to the performer -only 1n the role of a "mon- 
itor," which 1s the deliberate application of formal knowledge "to alter the 
output of the acquired system ... to* Improve accuracy" (Krashen, 1981, p,2). 
The monitor model may also account for the ability to edit a piece of writing, 
which could Improve the overall presentation as well as the granmar. In this 
way, the monitor model relates to the second hypothesis as well. 

* • • 

An additional /eason for comparing class to home compositions, besides 

« 

an examination of whether the additional time allows the monitor to surface, 
is to respond to the Inherent sense tha writing in class 1s a very unnatural 
situation and perhaps cannot lead to work .which 1s truly reflective of any- 
one's best capabilities. This philosophy 1s advanced 1n a report by Sanders 
and LHUefield (1975) who polnt'out: "Unfortunately, the rigidly controlled 
essay test situation surely represents the ultimate in an artificial writing 
situation; as such, 1t 1s exactly the kind of situation shunned in maay 
modern composition courses" (ptT47). All in all 4 our intuitive sense 1s that 
writing produced with a fa^day deadline should be superior to writing pro- 
due^ with a 50-minute deadline. 
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• The third hypothesis, relating to '.the relatlr . : tween the syntactic 
level and the discourse level, stems fronrthe assumpu.on that different skill 
areas contribute Independently to the total "success" of a piece of writing. 
The multiplicity of skills Involved further contribute to the overall d1 f f 1 - 
culty of writing. ColHnfs and Gentner (1980) make the following observation: 
' Much of the difficulty of writing stems from the large number of con- 
stralnts that must 4 be satisfied at the same time. In expressing an Idea 
the writer must .consider at least four structural levels: overall text 

» » 

structure, paragraph structure, sentence structure (syntax), and word 
structure — Clearly the attempt to coordinate all these requirements 
1s a staggering job. (p. 67) 

If various aspects- of writing are seen as levels which must be coordinated, it 
'is reasonable to hypothesize that success may vary from level to level. 

Subjects 

■ if / 
The subjects 1n this study were all undergraduate foreign students en- 
rolled 1n\£peciaJ sections of /reshroan composition for International students 
at the University of Southern California (USC), the highest level required 
composition course at the time^. Twenty-five students were selected — in 
groups of five — to represent the five largest foreign language groups at 
USC: Arabic, Chinese, Japanese, Persian, and Spanish. The studerfts were ran- 
domly drawn in a stratified random sample from five different sections of, the 

, 9 

course. Collectively, the subjects are felt to match the population of a 
typical cUss of 25 foreign students where students, in any one class are 

heterogeneous both in their nati.ve language and in their language backgrounds. 

3 
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Procedures ' L 

• « » » 

Each of the 25 subjects conAMbutejd four essays t;o the data base. Two 
of the essays were written Jn class Jn a test-like situation where the topics 
were not announced In advance. The subjects had to plan, write^, and rewrite 
their essays within the^space of one class lesson, typically 50 minutes. 
Two of the essays were written at home, anu topics were distributed .10-14 
days before the essay had to be handed 1n. 

The findings to be reported here stem from two rather separate ways 1n 
which the data was coded. In the first procedure, to test Hypothesis 1, each 
composition- was examined in detail and every single syntactic/error on the ' 
sentence level was identified and labelled, except for spelling, whicj was 
over looked. (the same procedure, followed by Nellson, 1979). The second pro-. * 
cedure, to test Hypothesis 2, was to evaluate the essays holistically for ad- 
herence to principles of organization* and coherence. In the holistic scoring, 
the essays were read an,d evaluated without regard to their syntactic accuracy. 
That Is, the readers overlooked 'all syntactic errors in arriving at a holistic 
"discourse" score. To test Hypothesis 3, the hpllstic score can be compared 
to a score representing the syntactic accuracy of the same composition in 
order tc determ'ine whethe* or n&t there was any correlation between the level 
of success in each skill area. This last procedure provides answers to the 
queitipn of whether 1t 1s possible to write a good essay in bad English or 
a bad essay in good English. 4 ■ " * 

Syntactic v Anatys 1£ 

Because writing 1s not syntax alone and because the analysis of grammati- 
cal accuracy .says little or, nr ning about the composition as a whole, I would 
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Hke to state two reasons why we must look at accuracy In writing. !ln the - 
first place, grammatical accuracy 1s' a major feature of standard written 
English/Secondly, one 1s drawn toward grammatical analysis because 1t 1s 
possible to codify, measure, and count various features within the grammar *of 
the language,. thus allowing the presentation of research findings In a * 
standard format. The measurement of grammatical accuracy allows us to com- 
pare achievement from one essay to' the next. 

. In cTosely examining each sentence 1n the corpus of essays, the crl- 
terlon for deciding whether oV not an error had been committed and, if so, P 
what type of error, was to determine what "syntactic reconstruction" could' 
most easily and economically [render the sentence into acceptable English 
given the context. Following this procedure, a total of 33 different cate- 
gories of error wer«v identified fir coding. In all, a total of 2,307 errors 
were identified and labelled in" the cor^us^of .100 composition: totalling 
1,599 sentences (28,444 words), 
• Distribution of Errors t 

The 33 categories of error can be grouped Into four major classes, viz. 
sentence structure errors, verb errors, reference errors, and word-level 
errors; and two unique classes, viz. article errors and punctuation errors. 
The distribution of errors into these six categories- is shown in Table V, 
which tabulates the percentage of each category that was found in the 50 class 
compositions and the 50 home ;ompositions. The percentages in each column 
total 100% (+ rounding error), as it is not possible for there to be a reduc- 
tion of percentage in one column or the other. In each case, 100% of ttys - 
errors are being divided into the corresponding categories. * 
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v Insert Table 1 about here 



In some sense, the first class of error, sentence structure, leads to 
more serious violations of English, for in general, errors found in this 
class sometimes would require a total reworking of the sentence before* 
meaning could be *accurateljy derived. , In contrast* errors of word-level 
choice,- which occurred more frequently, rarely interfered with communication, 
and the intended meaning could almost always be readily grasped despite the 
deviation frpm standard wriiten English. ' 

As the^writers in this s^tudy were all advanced learners of English, 1t 
should not seem surprising that a much smaller percentage of the error corpus 
fell into the categori ^grouped under sentence structure as compared with 
those categories grouped under word-level choices. When errors did occur, 
they tended not to be in the class of the more serious violation. 

Another way to assess the difference between the occurrence of sentence' 
structure and word-level errors is to consider the rank order distribution 'of 
the 33 categories. Such a calculation indicates that the average of the ranks 
for all 14 sentence structure errors is 20.8, while the average of ranks for 
the 7 word-level errors is 11.1. This reinforce? the finding that on the per- 
formance level, subjects fared worse with choices on the word level than with 
choices related to structures beyond the word. In correlation tests of the 
distribution of errors in class and at home, the Spearman rho for all. 33 
errors is .904, with a significance level of p<.05. v As tkje very high corre- 
lation shows, there is'a very similar distribution'of the error categories in 
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• class and home compositions. We can onT7 point to tendencies in differences 
between performance on class and home compositions; we cannot establish that 
the students' error pattern was significantly different. (For a full «d1r-. • 
cusslon of the categories of error and their rank order, see Kroll , 1982.) 
Accuracy Ratio . • • ? • 

Apart from tabulating the total number of ♦ errors and categorizing their 
distribution, we need to measure the occurrence of error within the framiwork 
; of the total composition. TJVat is, we need to measure the relationship be- 
tween error (what is wropg) and accuracy (vyhat is right). The importance • 
of this t ste'p can be seen by taking a hypothetical example. Suppose Student 
A made 10 errors of any nature fn'a composition of 10 pages totalling 2,500 
words while Student B made 10 errors of a similar nature in a composition 
totalling 150 words. We could not call their performances slmilareven 
though the quantity of errors- is similar. The counting of syntactic errors, 
only becomes meaningful within a consideration of the range of opportunity 
for error. 

In the present study, the sentence was taken as the basic unit under 
focus in checking the syntax. Each word within the sentence was seen as a 
possible "opportunity" for error as well' as the sentence itself (the latter 
giving rise to such categories as run-on and fragment). Using the total, 
number of words in a composition and tabulating the number of errors is one 
of the standard measures used in forming the basis for * kind of accuracy 
ratio (see, for example, BrieYe, 1966; Games, 1978). 

In Ta^e 2, "a general or overall accuracy ratio is shown for each lan- 
guage group. These figures are derived from a two-step procedure. First, the 
total number of words in each composition 1s dividend by the number of errors 
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1n each composition. Then the resulting Individual accuracy scores for the 
subjects 1n each language group are averaged for class and home compositions'. 



Insert/ Table 2 about here 



The numbers '1n Table 2 can be read, for example, as follows: there are 
an average of 19.4 words between each error 1n . class compositions" written by 
Arabic speakers. The higher the ''number, the fewer errors are found pro-* 
.portionat'ely, while conversely, the lower the number, the greater the pro- 
portion of errors. The highest number here, 22.7, shows the Arabic speakers 
had one error every 22.7 words in the home corpus in contrast to the lowest 
number, 7.8, representing one error every 7.8 words for the Japanese class 
corpus. Since these numbers are r< fc 'os, they cart be compared, and we can 
say, for example, the Japanese writ*. in class had more, tiian twice as many 
errors as the Arabs writing at home.- Taken as a whple for both class and 
home, the group averages show the Arabic speakers as having the most accurate 

\ 

V 

prose and. the Japanese the most flawed. 

4' 

Also according to this table, we 'see that all of the five language groups 
show a proportionately better performance (at least minimally) 1n home compo- 
sitions over class compositions, averaging out to means of 14.8 in class vs. 
18.0 at home. What accounts for this is the relation between the increase 
in the number of words written at h^ome and the corresponding increase or de- 
crease 1n the number of errors; all groups produced more words at home, but 
uie proportion of errors went both up and down. 

The Spanish group performed only marginally better at home than in clasps. 
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In their case, the number* of words Increased by 8.5* for home compositions, 
but the number, of errors increased by 21.5%. Iti actual fact, the la^ck of 
marked Improvement 1n the Spanish group's home performance mostly!, derives from 
problems with, only two of the 33 error categories: *ord choice and wprd form, 
as summarized 1n the chart below: / ' - 

Error Category Class Error Count Home Error Co unt 
Word choice ' 7.9% N*24 . 13.4% Ns-49 

Word form / 7.3% N=22 10.4% N*38 

Total: 15.2% N*46 23.8% ; N=87 

Although th^Spanish-speaklng subjects produced by far the most lengthy cor- 
pus ^alj the groups, their 'high incidence of error, particularly in the two 
categories cited above, gives them the second lowest accuracy ratios after 
the Japanese subjects, who collectively produced the shortest corpus. This 
latter fact underscores., perhaps, the poor performance of the Japanese whom 
we might say had a reduced opportunity for error given their shorter papers . 
but who managed tomake proportionately .more errors than any other group. 
Discussion of Syntactic findings a 

, Of the 33 categories,, the one showing the greatest reduction 1n error 
rate moving from class to home* was verb tense, while the one showing the 
greatest increase in error rate was article usage. Verb tense accounted for 
7.1% of the % class errors, which wasjthe fourth ranking error. For home compo- ^ 
sitions, the percent of error was reduced to 4.5%, which ranked seventh of 
all errors made at home. Articles/accounted for 10.8% of class errors, the 
third ranking error, but rose 'to 14.0% of the errors at home, becoming the 
number one ranking error. 

We might surmise that is was possible for subjects to^pprove their per- 

< 14 
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• formance at the level of verb tense selection when they had sufficient time 

' to allow thejm to proofread their papers. This would help, them access their 

monitors, which could easily Include a kntyledge of the rules for verb tense. * 

However, Inasmuch as the rules for articles are complex and difficult, and not 

the kfed of rules that ESL students can generally articulate, 1t 1s more 

« 

likely that their performance would be^ haphazard, and extra time would not 
help them. In actual fact, all five language groups showed worse performance 
with articles at home, though this was especially true for the Persians, and 
only marginally true for the fy'abic and Spanish speakers. 

According to the accuracy ratios examined on a subject by subject basis 
(see Kroll, 1982), 64% of the subjects did better at home while 36% performed 
with greater syntactic accuracy in c^ass. An additional tabulation of'*the 
average number of different categories of error shows that 72% of the" subjects 
had a* narrower range at home, while 24% had a narrower variety of error types - t 
when writing in class. The percentage of subjects who simultaneously showed p 
a better accuracy ratio at home together with a narrower range of error cate- 
gories was 60%, while 24% show both a better accuracy ratio and a narrower 
range of error in class. All in all, we would have to say that subjects did 
write better when they had more time to prepare their essays although their 1 
improvements were^-npt statistically significant. - j 

Holistic Evaluation 
The second measure which was used to code the data was to assign a 
holistic score to represent each essay's adherence to principles of organiza- 
tion and coherence, or what might be termed the pure discourse features of. an 
essay. The key to holistic evaluation is to establish some sort of written v 
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guidelines or rubric which sets out the principles with' which a'/eader 1s to 
judge a set of essays. ' These procedtres of holistic evaluation are reviewed 
by Myers (1980) and Najlmy (1981), while, Cooper (1977) gives an overview of* 
' the varieties of holistic evaluation. 

The key to the rubric which was developed was that readers had to over- 
look and Ignore all errors not related to the features directly under examl- 
nation, and to focus solely on the "larger" jssues of discourse. This pro- 
cedure necessitated read'ng through the errors of .syntax and attending only 
to- the level of organization and coherence. In other words, the scores th*t 
Were assigned to* each Individual essay rated them from 1 to 6 on a package of 
Isolated discourse properties and not on the basis of the essay as a whole. 
The essays were being scored t as 1f they had np-.^ra|waticaV4p^rs when 1n 

fact they ave^agea" one error every 15 to 18. words. (Focusing beyond the 

» > 

Jeyel of syntax to evaluate essays was similar 1n Intent to work done by . 

§> 

Freedman, 1977, though quite different in procedure.) 

For the rubric used 1n this study, those features which most contributed! 
to a high holistic score Included '(but were not limited tof\ r 

1. focused limitation of the topic 

2. remaining on the focused topic throughout the essay 

4 

3. effective use of paragraphing 

4. consistency in point of view 

5. logical sequencing of Ideas / 

6. artful use of transitions 

/ 

Identifiable features which lowered the score of a paper included (but 'were 

r 

not limited to): 
> 1. noticeable introduction of irrelevancies 
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2. failure to provide a cfear sense of purpose 

3. shifting point of view ' • , 

4. Infelicitous, Inappropriate or non-existent transitions 

5. assumption of an argument's, validity with no development of the » 
argument . 

Two ESL teachers experienced in the reading of compositions and with ^ 
pjcevious practice in holistic grading were trained as graders for the essays. 
After the training session, readers went through the essays which had ijo 
markings' to indicate whether they had been written in class or at hom£, and 
also had no markings as to the language origin of the subject. The readers 
were aWe to achieve an Inter-rater reliability coefficient of .85, showing 
a high degree of agreement on "the scores. 
Holistic Performance by Language Groups * 

In order for a paper to merit an upper half grade '(4,- 5, or 6), it had 
to demonstrate control over both the structure of the^essay^and the structure 
of individual paragraphs. With this 1n mind, even a score of 4 demonstrates 
a fair degree of discourse fluency. Table 3 summarizes the percentage of 
upper half and lower half scores for each language group In class and at 
home. (Since the njifnber of compositions in each cell is 10, the percentage' 
corresponds to the number of compositions, i.e., 50% equals five compositions. 



Insert Table 3 about here 



As seen in Table 3, for class compositions, the Chinese, Persian and 

4 • 

i 

Spanish subjects had the same distribution of scores (40% upper vs. 60% 
lower) with the Arab breakdown for the scores fairly similar at 50% and 50%. 
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Only the Japanese subjects had a noticeable difference In upper half and" * 
lower half scores. The preponderance. o^lower half scores for (he Japanese 
both at home and in class ranks the Japanese essays as the worst 1Jn terms, of 
djscourse fluency, .(it; the opposite extreme, the Arabs show the>largest per- 
centage of scores in. the upper half arid emerge as the group with the best ' 
discourse fluency. . * 

x The.actual mean scores of all language groups is shown on' Table 4. All 
*«ve language groups averaged slightly higher scores for the home compositions 
(including the Japanese), but T-tests for significance Indicate that none of 
the differences are statistically significant/ However, we should not dis- 
count the evidence of improvement in the home condition. 



Insert Table 4 about here 



Distribution of Holistic Scores 

We can also consider the distribution of the scores 1n the corpus irre- 
spective of the subjects' language background. This fs done by tabulating the 
total number of essays which received each of the possible scores. Such a 
breakdown is shown 1n Table 5 (as computed 1n percentages)* Not surprisingly, 
the majority ofthe scores cluster around the mid-range of possible scores. 
Here we see that .of class compositions, S6% received scores ranging from 3 - 
4.5, while 52% of the home compositions did, Indicating that just over half of 
the papers were # neither very poorly organized nor very well organized. 



Insert Table 5 about here 
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The percentage of scores at the very bottom of- the scale decreased by 
v half from class to home (from 16% to 8%), while the percentage of highest 
scores tripled tfrom Z% to 6%). Even though the actffal number* of 'V scores . 
1s quite small , it Is Important to note 'that more such scores appeared In, 
home compositions .Remember that the readers assigned scores „to papers with- 
out knowing whetheri 1|hey had been written in class or at home. 

Totalling the percentage -for lower hall; scores vs. upper "half scores 
shows that while lower half scores clearT^outnumbered upper, half" scores in 
class compositions (62% vs. 38%), the gap was considerably narrowed\in home 
compositions (52% vs. 48%).* In other words, there was a shift of 10 percent- 
age points in -the movement from class to home 1n the direction of more upjDer 
half scores. Another, way to point to the difference is by noting that the 
ratio of bottom to tpp Scores 1n class was slightly more than 2:1, while the 
ratio of bottom to ^top scores at home -was approximately 6:5. All of this 
shows that 1n group terms, the subjects wrote better organized compositions 
at home. With increased time, they were able to reduce somewhat the Incidence 
of the poorest level of performance and noticeably increase the Incidence of 
"above par performance. 
Discussion of the Holistic Results 

\ 

In terms of home vs. class essays, it ^ppears that there is a tendency 
for subjects to write higher rated essays at home, based on the group mean 
•scores of 3.2 for class vs. 3.6 for home. In fact, at least minimally, all 
five groups scored higher means for home essays than for class essays, though 
none of these differences are statistically significant. On an Individual 
basis, 52% of the subjects (N»13) averaged higher scores for their two home 
essays over their two class essays, while only 32% of the subjects (N*8) 
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. 'average^ ower scores. . In his dissertation, Hartvigsen (1981) found a simi- . 
.lar distribution of holistic scores for 1n-c1ass. vs. out-of-class essays 
written by native speakers. In Ms sampled approximately* 502 of the subjects 
had higher mean scores for. their out-of-oQass essays, while only 14% had 
higher means for In-class essays (with 36% of his subjects Having the same 

f 

- means). Despite the lack of statistical significance of the findings. 1n the 
present study, we would have to say that trtere 1s some support for Hypothesis 
2, namely, students can ^produce better organized essays given more time'. • 

The Interface of Syntactic and Rhetorical Assessments 
Once we have been .able to establish scores which assess the syntactic 
accuracy of each composition and asilgn 1t an evaluation of discourse/ rhetorl- 

v. 

cal effectiveness, 1t 1s now possible to address the third hypothesis of the 
study which predicts that there 1s no necessary relationship between these 

* • * 

two areas. 

» 

If we consider the holistic score of the Individual compositions together 
with their accuracy ratios, we can see that there 1s no real' pattern to the 
way the two scores occur as pairs in the 100 compositions (see Kroll, 1982 
for the actual figures). * 

\ 

\ In fact, the results of the Spearman correlation test for these scores 
show that the two scores. for the compositions are not statistically correlated. 
The value of rho (the correlation coefficient) in each case is exceedingly 
low: rho * .083 for class essays and rho * .C143 for home essays. „ Neither of 
these values is significant at the p <\05 level. If the scores were corre- 
lated, that .would show that one score 1s connected to the other ariti po- 
tential^ predictive of the other. In other words, such a correlation would 

20 
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show that there is a relationship between discourse fluency and syntactic 

accuracy. However ,i as that 1s not the case* we can claim rather that the 

♦ 

data support Hypothesis 3, viz., there 1s no necessary relationship between 
syntactic accuracy and discourse fluency. 

.* • fi ■ 

The lack of relationship between the word[s/error ratios and the holistic 



scqgftg is also revealed in tabulating the ranges of accuracy ratios that co- 
occur with each possible holistic score. This is~shown in Table 6. . 

^ Insert Table 6 about here 



Both the lowest holistic scores of 1 - 2.5 and the highest holistic 

♦ 

scores of 5 - 6 co-occur with relatively high and relatively low words/error 
jpatios. If there were a correlation to the scores, we would expect to find 
Vow score's on the holistic scale corresponding to low scores in the range 
of accuracy ratios, and so on. . • 

These results can provide' answers to the questions posed earlier in the 
study of whether it is possible to write good essays in bad English and bad 
essays in good English.- . 

In fact, the answers: to both these questions 1s the same. Subjects*can 4 
show control over the level of either syntax or rhetoric while simultaneously 
showing poor control at the other level. So, we cannot predict their ability 
to perform in one area on the basis of their performance 1 in the other one. 
We do not teach one skill by teaching the other. 
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Conclusions altd Implications 



In this study, we have seen a definite but statistically 1nsign1c1ant 
tendency for students to write better at home than 1n class. Glased on the 

measures used 1n this study to assess syntactic accuracy and discourse 

*' . 

fluency, 1t appears that students Improved at both levels at home. In fact, 
64% of the subjects averaged higher syntactic accuracy ratios when,wHt...y 

♦ « * 

at home while 52% of the subjects averaged higher holistic scores 'or their 
home compositions. Although more student? Improved at the syntactic level, 
.the gains made at the rhetorical level were larger, that 1s, the Increase 
In the percentage of occurrence for upper half holistic scores 1n the home ~ ... 
compositions appeirs to be more noticeable than the Increase made 1n the / 
accuracy ratios reflecting an Increased number of words between errors. 

// 

Intuitively, we would expect that having additional time to prepare a 
writing assignment would allow. a student additional t1n;« to thfnk through ahf" . 
Interpretation of an assignment before actually beginning to write. This 
gestation period may contribute more to allowing an organizational strategy' 
to surface than 1t can contribute to tne emergence of correct grammatical 
forms. In effect* the pre-writ1ng or pre-th1nking of an essay is almost 
invariably on the organizational level. Writers attend more to content than 
to form before sitting down -to write. Attention to the grammatical level 1s 
almost always part of the revision process, where rs- reading allows one to 
check rules and attend to form, i.e., monitor the output. The fact "that the 
syntactic level improved only slightly 1n moving from class to home (although 
it did improve for all groups) may attest to the fact that subjects did wot 
spend much, 1f any, time 1n revision at all. Without a specific injunction to 

* 

S * 
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focus on form, perhaps few students do. Perhaps so few rules can be learned 
and 'made a part of conscious knowledge that 1t 1<s really only possible to 
monitor a very small percentage of the language output. In any case, 
surely many teachers have had the suspicion that spme essays handed 1n after 
10-14 days appear to have been written in the same 50 minutes allowed 1n 
one class period, if not written 1n even less time than that. 

Many students appear to be convinced that they cannot write under 
pressure of time and ttyj^f tne y were^jl lowed to^ prepare essays outside of 
class, their performance (and presumably their ^grades) would noticeably 1m- 
prove. Based on the results of this study, this is only marginally true. 
Furthermore, the distribution of the specific language errors is remarkably 
similar in essays written^in class and at home. Therefore, Tt is fair to say 
that iV-class writing samples are as representative of a student's grammati- 
cal abilities as out-of-class samples. 

Perhaps the,, students who wrote better in class or those who made only 

slight gains did not krj^ enough about what constitutes good writing 1n the 

first place, so that their performance was accidental rather than calculated. 

They may have had no way to access information about how to write better be- 

» 

cause they did not have any mental formulation of what constitutes good 
writing. In such cases, time could not buy students anything because they 
would not know how to proceed in the task of writing. Such students may 
attack every task with the same lack of skill regardless of the conditions 

♦ 

they are writing under. . 
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Table 1 



Distribution of Major Classes of Syntactic Error 

. "'•".> ' •. • " f 

Error Category : . Class Percentages w Home Percentages 

Sentence Structure Errors 21.3 18.0 

Verb-Centered Errors . 16.8 12.3 

Reference Errors 6,.9 SJS 

Word-Level Choices 38.6 36.6 



* 



( 



Articles 10.8 14. 0 

Punctuation 11.8 . 13.5 

N" 1142 1165 
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Table 0 

Mean Indlv^dualAccuracy Ratios by Language Group 



• 




nome 


# Arabic 


19.4 


22.7 


Chinese 


15.9 


20.7 


• 

Japanese . 


7.8 


12.0 


Persian f 


16.8 


^ 19.3 


Spanish 


14.0 


15,5 


Group Mean: 


14.8 


18.C 
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Table 3 ^ 

Upper Half vs. Lower Half Scores by Language Group 

s : Class • 





Upper Hal f 


Lower Half 


Arabic 


50% 


50% 


Chinese 


40% 


60% 


Japanese 


20% 


80% 


Persian 


40% 


60% 


Spanish 


40% 


60% . * 



Group Means 38% 



62% 



< Home 



Upper Half 


Lower Half 


' 80% 


20%' 


60%. 


40% 


10% 


90% 


30% 


70% 


60% 


40% 


48% 


* 

52% 
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Table 4 

Holistic Scores by Language Group 

Class Mean Score 



r 



Arabic 

Chinese 

Japanese 

Persian 

Spanish 

.Group Mean 



3.8 
3.4 
2.4 

3.2 
3.3 

3.2 
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Home .Mean Score 
4.2 
3.7 
2.8 
3.3 
4.1 



3.6 
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Table 5 

Distribution of Hollstlt Stores 

Score 
1, 1.5 
\l. 2.5 
3 

4, 4,5 

5, 5,5 
6 



■4, 



Class 
,16% 
14% 
32% 
24% . 
12% 
2% 



Total lower half * 62% 
Total upper he * " * 38% 



Home 
8% 
18% 
26% 

• 26% 
16% 

^6% 
52% 
48% 
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T *bie 6 

Range of Words/Error Ratios Found for. Each flol 1st 1c Score 

Home 

Range ^Words/Error 



Holistic Score 
1, 1.5 
' 2, 2.5 
3 

4, 4.5 

5, 5.5 
6 



Cfass 
Range Words/Error 
5.3 - 35.0 
9.3 - 32.2 
5.0 - 17.6 
5>4 - 33.4 
8.8 - 66.4 
- 22.3 



*7.0 - 21.4 
.7.4 - 54.0 
6.0 -* 18.5 
6.7 - 86.3 

10.0 - 37.8 
9.1/- 28.4 



Class & Home 
Range Words /Error 

5.3 - 3&.0 

7.4 - 54.0 
5.0 - 18.5 
5.4 - 86.3 
8.8 - 66.4 
9.*1 - 28.4 
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